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Amendments to the Claims;; 

This Ksting of claims will replace all prior versions, and listings of claims in the application; 
Listing of Claims: 

1 . (Original) An image processing apparatus for generating new image 
data having pixel values having all color information for each interpolation point set on a two- 
dimensional plane, from original image data made up of many pixels which are arrayed in a 
matrix on tiie two-dimensional plane and each of which has only a pixel value representing a 
predetermined color information level obtained by an image sensor having individual color 
filters, comprising: 

a replacement unit for^ for a pixel value of a pixel that need not be replaced by 
another pixel value among pixel values contained in the original image data, adding replacement 
information repres^ting non-replacement of the pixel value to the pixel value, and outputting 
the pixel value as replacement information-added image data, and for a pixel value of a pixel that 
needs to be replaced by another pixel value, replacing the pixel value by a predetermined pixel 
value, adding replacement information indicating replacement of the pixel value to the replaced 
pixel value, and outputting the pixel value as replacement information-added image data; and 

an interpolation unit for outputting interpolated pixel values having all color 
information by interpolating a pixel value at an interpolation point for each color information on 
the basis of a predetermined arithmetic expression from pixel values of pixels of the same color 
felling within a predetermined interpolation region containing the interpolation point among all 
replacement information-added image data output from said replacement unit, and when 
replacement information of any pixel used for calculation indicates replacement, using an 
arithmetic expression different from the arithmetic expression. 

2. (Original) An apparatus according to claim 1, further comprising; 
a compensation value calculation unit for calculating a pixel compensation value 
for compensating for a pixel value at the interpolation point based on a predetermined arithmetic 
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expression from pixel values of a plxjrality of pixels which are positioned around the 
interpolation point and fell within a compensation region wider than and inchiding the 
mteipolation region, and when replacement information of any pixel used for calculatian 
indicates replacement, calcxilating the pixel compensation value based on an arithmetic 
expression different from the arithmetic expression; and 

a compensation unit for compensating for the interpolated pixel value at the 
interpolation point output from said interpolation unit &r each color faiformation using the pixel 
compensation value at the interpolation point calculated by said compensation value calculation 
unit, and outputting the interpolated pixel value as a new pixel value having all color information at 
the interpolation point. 

3 . (Original) An apparatus according to claim 1 , wherein said replacement 
unit detmnines ^^^idh^ to replace each pixel value^ on the basis of defect information indicating 
presence/^absence of a defect of each pixel of the image sensor. 

4. (Original) An apparatus according to claim 1 , wherein said replacement 
unit rq)laces a pixel vahie using a pbcd value of a pixel of the same color positioned neighboring the 
pixel, 

5. (Original) An ^paratus according to claim 2, wherein said 
compensation value calculation unit calculates a pbcd compensation value at an interpolation point using 
a pixel value having color information as a representative of a luminance component of original 
image data amomg pbcels Ming withm the conq)eDsati0n region. 

6. (Currentiy amended) An apparatus according to olaim 4- 

An image processing apparatus for generating new image data having pixel values 
having all color information for each interpolation point set on a two-dimensional plane, from 
original image data made up of many pixels which are arrayed in a matrix on the two- 
dimensional plane and each of which has only a pixel value representing a predetemiined color 
information level obtained by an image sensor having individual color filters, comprising: 
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a replacement unit for, for a pixel vahe of a pixel that need not be replaced by 
another pixel value among pixel values contained in the original image data, adding replacement 
information rqjresonting non-replacement of the pixel vahio to the pixel value, and outputting 
the pixel value as replacement infbrmation-added image data, and for a pixel value of a pixel that 
needs to be replaced by another pbcel vahie, replacing the pixel value by a predetermined pixel 
value, adding replacement information indicating replacement of the pixel value to the replaced 
pixel value, and ou^tting the pixel value as replaconent information-added image data; and 

an inteipolation imit for ou^utting interpolated pixel values having all color 
information by interpolating a pixel value at an interpolation point for each color information on 
the basis of a predetermined arithmetic expression &om pixel values of pixels of the same color 
fiilling within a predetermined interpolation region containing the interpolation point among all 
replacement information-added image data output from said replacement unit, and when 
replacement information of any pixel used for calculation indicates replacement, using an 
arithmetic expression different from the arithmetic expression, 

wherein when target calculation pixds used to calculate the interpolated pixel value 
include a pixel whose rq}lacement information indicates^ an arithmetic expression is used, which 
has a reduced weight coefficient oomporing asjaanpared to a normal arithmetic expression for 
calculating the interpolated pixel value, or has a weight coefficient of 0 for the pixel or a 
plurality of target calculation pixels including the pixel. 

7. (Currently amended) An apparatus aooording to claim 2, 
An image processing apparatus for generating new image data having pixel values 
having all color information for each interpolation point set on a two-dimensional plane, from 
original image data made up of many pixels which are arrayed in a matrix on the two- 
dimensional plane and each of which has only a pixel value representing a predetermined color 
information level obtained by an image sensor having individual color filters, comprising: 

a replacement unit for, for a pixel vahie of a pixel that need not be replaced by 
another pixel value among pixel values contained in the original image data, adding replacement 
information representing non-replacement of the pixel value to the pixel value, and outputting 
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the pixel value as replacement inforxixation-added image data, and for a pixel value of a pixel that 
needs to be replaced by another pixel value, replacing the pixel value by a predetermined pixel 
value, adding replacement information indicating replacement of the pixel value to the r^laced 
pixel value, and outputting the pixel value as replacement information-added image data; 

an interpolation unit for outputting interpolated pixel values having all color 
information by interpolating a pixel value at an interpolation point for each color information on 
the basis of a predetermined aritfimetic expression &om pixel values of pixels of the same color 
falling within a predetermined interpolation region containing the interpolation point among all 
replacement information-added image data output &om said replacement unit, and when 
replacement information of any pixel used for calculation indicates replacement, using an 
arithmetic expression different ftom the arithmetic e^qpression 

a compensation value calculation unit for calculating a pixel compensation value 
for compensating for a pixel value at the interpolation point based on a predetermined arithmetic 
expression from pixel values of a plurality of pixels which are positioned around the 
interpolation point and fall within a compensation region wider than and including the 
interpolation region, and when replacement information of any pixel xiscd for calculation 
indicates replacement, calculating the pixel compensation value based on an arithmetic 
expression different from the aridimetic expression; and 

a compensation unit for compensating for the interpolated pixel value at the 
interpolation point output from said interpolation unit for each color information using the pixel 
compensation value at the mterpolation point calculated by said compensation value calculation 
unit, and outputting the interpolated pixel value as a new pixel value having all color information at 
the interpolation point; 

wherein when target calculation pixels used to calculate the pixel compensation 
value include a pixel whose replacement information indicates replacement, an arithmetic 
expression is used> which has a reduced weight coefiGcient comparing as compared to a normal 
arithmetic expression for calculating the pixel compensation value, or has a weight coefficient of 
0 for the pixel or a plurality of target calculation pixels including the pixel 
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8. (Original) An apparatus according to claim 2, wherein when target 
calculation pixels used to calculate the pixel compensation value include a pixel whose 
replacement information indicates replacements said compensation value calculation unit outputs 
a pixel con^)ensation value indicating non-compensation, 

9. (Currently amended) An - apparatup aooordang to olaim 4' 

An image processing apparatus for generating new image data having pixel values 
having all color information for each interpolation point set on a two-dimensional plane^ from 
original image data made up of many pixels which are arrayed in a matrix on the two- 
dimensional plane and each of which has only a pixel value representing a predetermined color 
information level obtained by an image sensor having individual color filters, comprising: 

a replacement unit for, for a pixel value of a pixel that need not be replaced by 
another pixel value among pixel values contained in the original image data, addmg replacement 
information representing non-replacement of the pixel value to the pbcel value, and outputting 
the pixel value as replacement information-added image data, and for a pixel value of a pixel that 
needs to be replaced by another pixel value, replacing the pixel value by a predetermined pixel 
value, adding replacement information indicating replacement of the pixel value to the replaced 
pixel value, and outputting the pixel value as replacement information-added image data; 

an interpolation unit for outputting interpolated pixel values having all color 
infomiation by interpolating a pixel value at an interpolation point for each color information on 
the basis of a predetermined arithmetic expression from pixel values of pixels of the same color 
falling within a predetermined interpolation region containing the interpolation point among all 
replacement information-added image data output from said replacement unit, and when 
replacement information of any pixel used for calculation indicates replacement, using an 
arithmetic expression different &om the arithmetic expression, w4 !^r e m 

floid appomtus further comprisoa 

a region value calculation unit for sequentially receiving pixel values forming the 
replacement information-added image data output from said replacement unit in parallel with 
each other by a predetermined number of pixel lines as pixel blocks for single pixel columns to 
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forai a sub-matrix from a predetennined number of pixel blocks received successively, 
calculating logical OR of replacement information and sums of pixel values of pixels included in 
respective regions set in advance on the sub-matrix as region values of the respective regions, 
and parallel-outputting the respective region values in synchronism with reception of the pixel 
block, and 

an interpolation imit selectively uses the respective region values parallel-output 
from said region value calculation unit to sequentially calculate, for each sub-matrix, interpolated 
pixel values at an interpolation point on a sub-matrix to be processed. 

10, (Currently amended) A a ^pparatus oeoording - to clftim - 2i; 

An image processing apparatus for generating new image data having pixel values 
having all color information for each interpolation point set on a two-dimensional plane, from 
original image data made up of many pixels which are arrayed in a matrix on the two- 
dimensional plane and each of which has only a pixel value representing a predetermined color 
information level obtained by an image sensor having individual color filters, comprising: 

a replacement xmit for, for a pixel value of a pixel that need not be replaced by 
another pixel value among pixel values contained in the original image data, adding replacement 
infonnation representing non-replacement of the pixel value to the pixel value, and outputting 
the pixel value as replacement infbrmation^added image data, and for a pixel value of a pixel that 
needs to be replaced by another pixel value, replacing the pixel value by a predetermined pixel 
value, adding replacement infonnation indicating replacement of the pixel value to the replaced 
pixel value, and outputting the pixel value as replacement information-added image data; 

an interpolation unit for outputting interpolated pixel values having all color 
infonnation by interpolating a pixel value at an interpolation point for each color infonxiation on 
the basis of a predetermined arithmetic expression from pixel values of pixels of the same color 
falling within a predetermined interpolation region containing the interpolation point among all 
replacement information-added image data output from said replacement unit, and when 
replacement information of any pixel used for calculation indicates replacement, using an 
arithmetic expression different frvmi the aridmietic expression; 
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a compensation value calciilation unit for calculating a pixel compensation value 
for comp^ating for a pixel value at the interpolation point based on a predetermined arithmetic 
expression from pixel values of a plurality of pixels which are positioned around the 
interpolation point and fall within a compensation region wider than and including the 
intetpolation region, and when replacement information of any pixel used for calculation 
indicates replacement, calculating the pixel compensation value based on an arithmetic 
expression different from the arithmetic expression; 

a compensation unit for compensatmg for the interpolated pixel value at the 
interpolation point output from said interpolation unit for each color information using the pixel 
compensation value at the intctpolaticn point calculated by said compensation value calculation 
uni^ and outputdng the intezpolafied pixel value as a new pixel value having all color information at 
the interpolation point; 

sold apparatus fiirtfaBr oomprigog 

a region value calculation unit for sequentially receiving pixel values forming the 
replacement information-added image data ouq)ut from said replacement unit in parallel with 
each other by a predetermined number of pixel lines as pixel blocks for single pixel columns to 
form a sub-matrix from a predetermined number of pixel blocks received successively, 
calculating logical OR of replacement information and sums of pixel values of pixels included in 
respective regions set in advance on the sub-matrix as region values of the respective regions, 
and parallel-ou^utting the respective region values in synchronism with reception of the pixel 
blocfcrr 

an interpolation unit selectively uses the respective region values parallel*output 
from said region value calculation unit to sequentially calculate, for each sub-matrix, interpolated 
pixel values at an interpolation point on a sub-matiix to be processed? ; and 

a compensation value calculation unit selectively uses the respective region values 
parallel-output from said region value calculation unit to sequentially calculate, for each sub- 
matrix, a pixel compexisation value at the interpolation point on the sub-matiix to be processed. 
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11. (Currently amended) An apparatus Qooording to olaim 1, wherein 

An image processing apparatus for generating new image data having pixel values 
having all color information for each interpolation point set on a two-dimensional piano, from 
original image data made ijp of many pixels which are arrayed in a matrix on the two- 
dimensional plane and each of which has only a pixel value representing a predetermined color 
information level obtained by an image sensor having individual color filters, coniprising: 

a replacement unit for, for a pixel value of a pixel that need not be replaced by 
another pixel value among pixel vahies contained in the original image data, adding replacement 
information representing non-replacement of the pixel valiie to the pbcel value, and outputting 
the pixel value as replacement information-added image data, and for a pixel value of a pixel that 
needs to be replaced by another pixel value, replacing the pixel value by a predetennined pixel 
value, adding replacement information indicating replacement of the pixel value to the replaced 
pixel value, and outputting the pixel value as replacement information- added image data; and 

an interpolation unit for outputting interpolated pixel values having all color 
information by interpolating a pixel value at an interpolation pouit for each color information on 
the basis of a predetermined arithmetic expression from pixel values of pixels of the same color 
idling within a predetermined interpolation region containing the interpolation point among all 
replacement information-added image data output from said replacement unit^ and when 
replacement information of any pixel used for calculation indicates replacement, using an 
arithmetic expression different firom the arithmetic explosion; and 

said apporatua fuitfa e r oompriacfl 

a dcfbct information generation unit for using relative pixel position information 
with respect to an immediately preceding defective pixel, position as information indicating a 
defective pixel position of the image sensor to determine whether each pixel forming the original 
image data is a defective pixel, and outputting a determination result as defect information to 
said r^lacement unit in synchronism with the each pbcel, mi wherdin 

said replacement unit determines whether to replace a pixel value on the basis of 
the defect ni farmati on from said defect informaticm gmeration unit in accordance with whether each 
pixel value inchided in the original image data cosresponds to a defective pbcel. 
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